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final  Report  for  Grant  ONR  N00014-90-J-1114 

"Pulse  Coded  Biologically  Motivated  Neural-Type  MOS  Circuits" 
for  the  Period  11/01/89  -  03/31/92 


1 .  Introduction  and  Main  Results 

This  project  has  had  two  aspects,  one  for  ONR  and  one  for  AFOSR. 
The  ONR  portion  was  devoted  to  obtaining  hardware  implementations  for 
the  physiological  representations  used  in  the  program  SYNETSIM  devel¬ 
oped  by  the  neurophysiologist  Dr.  D.  Hartline  of  Bekesy  Laboratories. 
The  AFOSR  portion  was  lor  evaluation  of  the  capabilities  of  pulse  coded 
neural  networks. 

The  main  results  of  this  research  are: 


1.  VLSI  designs  of  SYNETSIM  modules  and  their  extensions 

VLSI  Designs  for  the  major  pools  of  SYNETSIM  were  made  and  MOSIS 
fabrications  carried  out.  from  these  some  new  elements  were  designed 
and  in  most  cases  fabricated  via  MOSIS,  the  key  ones  being  a  neural 
type  arithmetic  unit,  an  adjustable  MOSFET  transistor  convenient  lor 
weight  setting,  and  considerable  improvement  in  the  neural  type  cell 
being  used  in  many  of  our  pulse  coded  networks.  Because  capacitors  take 
a  large  amount  of  the  VLSI  chip  area,  a  new  capacitance  multiplier  was 
designed  and  fabricated.  Using  the  pools  a  realization  fo  ARTl  memories 
was  obtained.  Means  for  realizing  long  term  potentiation  were  investi¬ 
gated  which  are  leading  to  a  new  concept  of  memory  based  upon  the  pools 
and  their  incorporation  of  second  messenger  effects. 

2.  Pulse  coded  realizations 

A  pulse  coded  neuron  lor  Boolean  functions  was  created  and  it  was 
shown  that  any  Boolean  function  of  two  variables  can  be  computed  using 
it.  This  li.:<ids  to  the  main  result  that  any  digital  system  can  be  rea¬ 
lized  as  a  pulse  coded  neural  network.  Similarly  a  teclinique  for  rea¬ 
lizing  any  neural  network  in  pulse  coded  form  has  been  developed  with 
investigat ions  lor  a  formal  proof  initiated. 

3.  Improvements  in  SYNETSIM  and  cross  fertilizations  between  neur¬ 
ophysiology  and  electrical  engineering 

Primarily  the  electrical  engineering  researchers  have  made  many 
improvements  in  the  user  interface  of  SYNETSIM  so  that  other  than  neur¬ 
ophysiologists  can  be  comfortable  in  using  SYNETSIM.  Among  those 
improvements  are  the  introduction  of  a  netlist  format  to  translate 
neural  network  ;:tructuro  into  the  numerical  data  used  by  SYNilTS.TM, 
improved  input  and  readout,  and  incorporation  of  modulation  of  all  par¬ 
ameters  via  introduction  ol  a  modular  form  to  the  program. 

4 .  Incorporation  in  Neural  Type  Microsystems 

Some  of  the  modules  of  SYNETSIM  are  not  directly  convenient  for 
realization  in  VLSI  form.  But  by  taking  the  ideas  behind  the.  modulof; 
and  reformulating  them  into  our  Neural-Type  Microsystems  framework  we 
are  able  to  incorporate  the  desired  behavior  in  simple  circuits.  For 
example  this  has  led  to  new  neural  type  cells,  the  primary  components 
of  our  neural  systems.  And  very  significantly  it  has  led  to  investiga¬ 
tion  of  means  to  realize  long  term  potentiation  and  memory  in  neural 
type  microsystems. 
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In  undertaking  these  results  a  large  number  of  individuals  were 
involved  with  eleven  University  of  Maryland  researchers  financially 
supported  at  various  points  in  the  research  including  some  very  moti¬ 
vated  undergraduates.  Several  researchers  at  other  institutions  have 
entered  cooperatively  into  those  research  activities  leading  to  a  num¬ 
ber  of  cross  fertilizations;  among  these  are  Dr.  D.  Hartline  and  his 
researchers  of  the  Bekesy  Laboratories  of  the  University  of  Hawaii  and 
Professor  M.  Zaghloul  and  her  students  at  George  Washington  University. 
One  Ph.D.  and  one  MS  degree  were  awarded  based  upon  this  research  with 
a  number  of  seminar  presentations  given  as  well  as  papers  presented  at 
international  meetings  and  in  internationally  recognized  journals  (see 
listing  below) .  The  research  has  led  to  a  number  of  new  research  areas 
which  are  planned  for  future  study,  including  that  of  modeling  live 
neurons  on  a  chip  and  new  concepts  of  memory  adjustment. 

Funded  participating  researchers  with  their  concentration  areas; 

I.  Primary  researchers 

ta .  Prof.  R.  Newcomb,  PI 

Oversight,  circuit  and  SYNETSIM  realizations 

b.  Ms.  N.  El-Lcithy,  Co-PI 

Long  Term  I’otentiation  research 

c.  Mr.  S.  W.  Tsay,  RA  -  ONR  portion 

VLSI  circuit  realizations  -  Ph.D.  obtained 

d.  Mr.  M.  de  Savigny,  RA  -  AFOSR  portion 

Pulse  coding  vs  voltage  levels  -  MS  obtained 

II.  Supplementary  researchers 

e.  Ms.  Shilpa  Mehta  -  undergraduate  Honor's  Fellow 

DRIVER  circuit  and  neurons  on  a  chip  simulations 

f.  Ms.  Shapna  S.  Pal  -  undergraduate  researcher 

DRIVER  circuit  and  neurons  on  a  chip  simulations 

g.  Mr.  Jen-dong  Yuh,  RA  (Ph.D.  Candidate) 

VLSI  and  multilevel  neurons 

h.  Dr.  George  Syrmos  -  postdoctoral 

Applications  of  pulse  coded  neural  networks  to  robotics 

i.  Mr.  Samer  Minkara,  RA  (Ph.D.  Candidate) 

Soliton  realizations  for  pulse  coding 

j.  Ms.  I.oiiiza  Sellami,  RA  (Ph.D.  Candidate) 

Hair  cell  neural  interfacing 

k.  Mr.  Gregory  Wolodkin,  RA  (MS  Candidate,  summer  at  Bekesy) 

User  friendly  improvements  of  SYNETSIM 

In  addition  a  number  of  other  graduate  and  undergraduate  students 
indirectly  participated  through  research  seminars  and  design  course 
activities  with  significant  contributions  made  by  P.  Bey,  S.  Lin  and  L. 
Chen.  Some  of  these  students  continue  to  participate  through  indepen¬ 
dent  study  projects  on  related  topics  which  have  resulted  from  the 
research.  A  numljor  of  technical  meetings  were  attended  including  one 
involving  <i  large  number  of  internationally  known  cell  neurophysiolo¬ 
gists  associated  with  tlie  "Decade  of  the  Brain"  celetar^itions . 
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2 .  Theses 

The  following  tv;o  theses,  which  were  finished  in  April  1991,  are 
based  upon  research  under  this  Grant. 

a)  S.-W.  Tsay,  "Design  of  Neural  Chemical  Pools  for  VLSI  and  Their 
Applications,"  Doctoral  Dissertation,  University  of  Maryland,  May  1991 
graduation . 

b)  M.  de  Savigny,  "Pulse  Coded  Neuron  Realizing  Digital  Func¬ 
tions,"  MS  Thesis,  University  of  Maryland,  May  1991  graduation. 

3 .  Publ i cat  1 ons 

A.  Appearing 

a)  S.-W.  Tsay,  N.  El-Leithy,  and  R.  W.  Newcomb,  "CMOS  Realization 

of  a  Class  of  llartline  Neural  Pools,"  Proceedings  of  the  1990  IEEE 
International  Symposium  on  Circuits  and  Systems,  New  Orleans,  May  1090, 
pp.  2417  -  2420.  j 

b)  G.  Wolodkin,  N.  El-Leithy,  M.  de  Savigny,  S.  W.  Tsay,  and  R. 
Newcomb,  "A  Semistatc  Description  for  Hysteresis  in  MOS  Nerral-Type 
Cells,"  Proceedings  of  the  33rd  Midwest  Symposium  on  Circuits  and  Sys¬ 
tems,  Calgary,  August  1900,  pp.  289  -  292. 

c)  M.  de  Savigny,  G.  Moon,  N.  El-Leithy,  M.  Zaghloul,  and  R.  W. 
Newcomb,  "Hysteresis  Turn-On-Off  Voltages  for  a  Neural-Type  Cell,"  Pro¬ 
ceedings  of  the  33rd  Midwest  Symposium  on  Circuits  and  Systems,  Cal¬ 
gary,  A'  ist  1990,  pp.  37  -  39. 

li  S.  W.  Tsay  and  R.  Newcomb,  "VLSI  Implementation  of  ARTl  Memo¬ 
ries,"  i  KEE  Trans, act  ions  on  Neural  Networks.  Vol .  2,  No.  2,  March  1991, 
pp.  214  -  221. 

e)  S.  W.  Tsay,  M.  do  Savigny,  N.  El-Leithy,  and  R.  Newcomb,  "An 
all  MOS  Neural-Type  Cell,"  34th  Midwest  Symposium  on  Circuits  and  Sys¬ 
tems,  May  1991,  to  appear. 

f)  S.-W.  Tsay  and  R.  W.  Newcomb,  "A  Neural-Type  Pool  Arithmetic 
Unit,"  Proceedings  of  the  1991  IEEE  International  Symposium  on  Circuits 
and  Systems,  Singapore,  June  1991,  pp.  2518  -  2521. 

g)  G.  Moon,  M.  ZagliJ.  oul,  M.  de  Savigny,  and  R.  W.  Newcomb,  "Anal¬ 
ysis  and  Operation  of  a  Nmiral-Typc  Cell  (NTC) , "  Proceedings  of  the 
1991  IEEE  International  :;ymposium  on  Circuits  and  Systems,  Singapore, 
June  1991,  pp.  2332  -  2334. 

h)  S.  W.  Tr.ay,  L.  Ch«  n,  N.  El-Leithy,  G.  Wolodkin,  and  R.  New¬ 
comb,  "Realization  of  the  Driver  Neural  Network  Module,"  Proceedings  of 
the  IV  International  Sym[)osium  on  Biomedical  Engineering,  Penlscola, 
Spain,  September  1991,  pp.  480  -  481. 

i)  Gyu  Moon,  Mona  E.  Zaghloul,  and  Robert  W.  Newcomb,  "VLSI 
Implementation  of  Synaptic  V^eighting  and  Summing  in  Pulse  Coded  Neural- 
Type  Cells,"  IEEE  Transactions  on  Neural  Networks.  Vol.  3,  No.  3,  May 
1992,  pp.  394  -  403. 

j)  Suan-Wei  Tsay  and  Robert  W.  Newcomb,  "Implementation  of  Hart¬ 
line  pools  and  Neu ra  1 -'ry[)e  Colls  by  VTjSI  Circuits,"  for  Advances  in 
Control  Networks  and  Largo*  Scale  Parallel  Distributed  Processing  Models 
edited  by  Martin  D.  Frvis.er 

k)  M.irc  de  Savigny  and  Robert  W.  Newcomb,  "Realization  of  Boolean 
Functions  Using  a  Pulse  Coded  Neuron,"  ISCAS'92,  San  Diego,  May  1992, 
to  appear. 

l)  Suan-Wei  Tsay  and  Robert  W.  Newcomb,  "An  Adjustable  Threshold 
MOSFET,"  ISCAS'92,  San  Diego,  May  1992,  to  appear. 

m)  Jen-dong  Yuh  and  Robert  W.  Newcomb,  "Circuits  for  Multi-Level 
Neuron  Nonl  Inearit les , "  IJCNN'92,  Baltimore,  June  1992,  to  appear. 
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B .  Drafts  in  manuscript  form 

a)  M.  de  Saviqny,  S.  W.  Tsay,  and  R.  W.  Newcomb,  "Capacitance 
Multipliers  for  VLSI  Integration  of  Larce  C." 

b)  Marc  de  Savigny  ajid  Robert  W.  Newcomb,  "Realization  of  Hop- 
field  Networks  with  Pulse  Coded  Neurons." 

c)  Jen-dong  Yuh  and  Robert  W.  Newcomb,  "A  Multi-Level  Neural  Net¬ 
work  for  A/D  Conversion." 
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